• Data Lakes (2) - How Iceberg's Core Features Work Liao Jiayi Liao Jiayi #Iceberg#Data Lake

    An exploration of Apache Iceberg's file organization, snapshots, deletes, schema evolution, and how its approach differs from Hudi.

  • Data Lakes (1) - How Hudi's Core Features Work Liao Jiayi Liao Jiayi #Hudi#Data Lake

    An overview of Hudi's design, timeline, table types, indexes, upserts, and incremental reads.

  • Why Do We Need Data Lakes? Liao Jiayi Liao Jiayi #Data Lake

    Growing interest in data lakes is driven by a qualitative change in user needs that traditional data warehouses and their components can no longer satisfy.

  • Hudi Liao Jiayi Liao Jiayi #Hudi#Data Lake

    Notes on Apache Hudi, the open-source data lake framework led by Uber and shaped by its data-processing needs.